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SUPPORT POINTS OF LOCALLY OPTIMAL DESIGNS FOR 
NONLINEAR MODELS WITH TWO PARAMETERS 

By Min Yang 1 and John Stufken 2 

University of Missouri-Columbia and University of Georgia 

We propose a new approach for identifying the support points 
of a locally optimal design when the model is a nonlinear model. 
In contrast to the commonly used geometric approach, we use an 
approach based on algebraic tools. Considerations are restricted to 
models with two parameters, and the general results are applied to 
often used special cases, including logistic, probit, double exponential 
and double reciprocal models for binary data, a loglinear Poisson 
regression model for count data, and the Michaelis-Menten model. 
The approach, which is also of value for multi-stage experiments, 
works both with constrained and unconstrained design regions and 
is relatively easy to implement. 

1. Introduction. Generalized linear models (GLMs) and other nonlinear 
models have found broad applicability during the last decades. Methods 
of analysis and inference for these models are well established [for GLMs, 
see, e.g., McCullagh and Nelder (1989), McCulloch and Searle (2001) and 
Agresti (2002)], but results on optimal designs are more sparse. 

In contrast to very general results on optimal designs for linear models 
with normal errors, many optimality results for nonlinear models are for 
specific optimality criteria and for specific cases in terms of the model, the 
design region and the parameters of interest. The significance of our results 
is their broad applicability, as will be demonstrated in the next sections. As 
in much of the past work, our method focuses on locally optimal designs. 
With nonlinear models, information matrices and optimal designs depend 
on the unknown model parameters, and one way to deal with this is to 
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identify locally optimal designs based on the best guess of the parameters. 
There are other ways to address this issue, for example, by using a Bayesian 
approach [see, e.g., Agin and Chaloner (1999), Chaloner and Larntz (1989) 
and Chaloner and Verdinelli (1995)]. There is also some interesting work on 
finding designs that are robust to the best guess of the parameters [see, e.g., 
Dror and Steinberg (2006)], in which case it would still be useful to know 
locally optimal designs. As pointed out by Ford, Torsney and Wu (1992), 
locally optimal designs are important if good initial parameters are avail- 
able from previous experiments, but can also function as a benchmark for 
designs chosen to satisfy experimental constraints. Hereafter, we omit the 
word "locally" for simplicity. 

We focus on nonlinear models with two regression parameters. These are 
the most studied nonlinear models, and our results will unify and generalize 
many of the available results. We will provide selected relevant references in 
later sections, and refer the reader to Khuri et al. (2006) for an authoritative 
recent review on design issues for GLMs. 

There can be many design questions that lead to different optimal de- 
signs. For example, a design, that is, .D-optimal for a certain problem may 
not be A-optimal. As another example, a design, that is, optimal for the 
two parameters may not be optimal for some function of the parameters. 
Moreover, optimality is a function of the design space, which is in many 
problems a constrained space. For example, in a toxicity study, a high dose 
level that exceeds safety limits is not acceptable. All these issues, coupled 
with the dependence of a locally optimal design on a guess of the parame- 
ters, complicate the optimal design problem tremendously. There are con- 
sequently very few general results on this topic. Among the exceptions is 
Biedermann, Dette and Zhu (2006), who obtained a series of excellent re- 
sults for a specific function of the parameters under a constrained design 
space and for various models and optimality criteria. 

Our strategy will be to identify a class of relatively simple designs so that 
for any design d that does not belong to this class, there is a design in the 
class that has an information matrix that dominates that of d in the Loewner 
ordering. Such a design will then also be no worse than d for most of the com- 
mon optimality criteria and for many functions of the parameters. The class 
of designs will depend on the design region — which can be constrained — and 
the model, and whether a design belongs to the class or not will depend on 
its support points. With these results, identifying an optimal design for a 
specific optimality criterion will then either reduce to a simple optimization 
problem or be solved by using the results of Pukelsheim and Torsney (1991). 
For further discussion we refer to Biedermann, Dette and Zhu (2006). In 
Section 6 we will observe that our approach is also useful in the context of 
multi-stage designs, which is especially helpful in cases where no good initial 
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guess of the parameters is available. We refer to Sitter and Forbes (1997) for 
further details. 

This article is inspired by the work of Mathew and Sinha (2001), who 
developed a unified approach to tackle optimality problems for the logistic 
regression model. Our approach successfully characterizes optimal designs 
under many commonly studied models. Moreover, the results apply for any 
functions of the original parameters and any commonly used optimality 
criteria. The results make finding optimal designs for nonlinear models with 
two parameters a simple task. 

For the layout of the remainder of the paper, we will introduce commonly 
used GLMs and the Michaelis-Menten model in Section 2. In Section 3 we 
will develop the main tools, which will then be applied to the introduced 
models in Sections 4 and 5. Section 6 concludes with a brief discussion. 

2. Statistical models and information matrices. All the models that we 
will consider have two parameters, which we denote by a and (3, and an 
explanatory variable x. For a given model, the exact optimal design problem 
consists of selecting distinct values for x, say xi, ■ ■ ■ ,Xj., and values for the 
number of observations nj at Xi so that the resulting design is best with 
respect to some optimality criterion for a fixed number of observations n = 
J2i=i n i- The Xi's are the support points of the design. This is a difficult 
and often intractable optimization problem, which has led to the use of 
approximate designs in which the n,'s are replaced by Wj's that satisfy uji > 
and = 1. Thus a design can now be written as £ = {{xi,uji),i = 

1, . . . , k}, and the problem of finding an optimal design becomes, once the 
support points have been determined, a continuous optimization problem 
rather than a discrete optimization problem. Identifying support points for 
an optimal design is therefore extremely important, and the methodology 
that we develop accomplishes precisely that for optimal designs with a small 
support size. 

For a given design £ and a two-parameter model for independent observa- 
tions, the Fisher information matrix for the parameters (a, (5) can be written 

as 




It(a,P) 



(a,/3)Cz(a,P)A(a,P). 



Here 



^Wi* 2 (Ci) 



k 



\ 



(2.2) 




i=i 
k 



i=l 
k 



^Wi* 2 (Ci) 



X^i*3(Ci) 



i=l 



t=l 
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is a matrix that depends on (a, (3) (through the Cj's) and on design £ 
(through the uVs and Cj's), while A(a,f3) is a matrix that depends only 
on (a,f3). The functions will differ depending on the model. The follow- 
ing examples introduce popular models to illustrate the notation in (2.1) 
and (2.2). 

Example 1. In dose-response studies and growth studies, a subject re- 
ceives a stimulus at a certain level x to study the relationship between the 
level of the stimulus and a binary response. The dose level in a dose-response 
study or the level of dilution in a growth study [see McCulloch and Searle 
(2001), Chapter 5] can be controlled by the experimenter, and a judicious se- 
lection of the levels must be made prior to the experiment. With Yi and x^ as 
the binary response and the stimulus for the ith subject, a basic generalized 
linear regression model for this situation is of the form 



Here, a and f3 are the intercept and slope parameters, and P(x) is a cu- 
mulative distribution function. Commonly used models of this form are the 
logistic, probit, double exponential and double reciprocal models. Most re- 
sults in the optimal design literature for GLMs are for (2.3). 

The information matrix for (a, (3) for (2.3) is of the form given in (2.1) 

and (2.2), where we may take A(a,/3) = (* c% = « + /3xi, ^i(ci) = 



{P'(ci)} 2 /[P(ci){l - P(a)}], * 2 (ci) = cstti(ci), and * 3 (a) = cf^( Ci ). 



Example 2. Generalized linear regression models, such as loglinear re- 
gression models [Agresti (2002), Chapter 9], can be useful for count data. For 
example, in a cancer colony-formation assay [Minkin (1993)], the capacity of 
a drug to reduce the formation of cell colonies is studied. The number of cell 
colonies observed at a certain concentrate level X{ of the drug is assumed to 
be a Poisson variable with mean 9{ and a loglinear model is used to describe 
the relationship between 0i and the concentrate level of the drug Xi . Minkin 
(1993) describes the model as 



Compared to (2.3), the optimal design literature contains fewer results for 
this model. Nevertheless, the information matrix for (a,/3) for (2.4) is also 
of the form given in (2.1) and (2.2) with the same choices as in Example 1, 
except that now ^i(ci) =exp(cj). 

Example 3. The Michaelis-Menten model is a nonlinear model that is 
widely used in the biological sciences. It is given by 



(2.3) 



Prob(Yi = 1) = P(a + /3xi). 



(2.4) 



log/9j = a + (3xi. 



(2.5) 



£i~N(0,a 2 ), 



(3 + Xi 
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where a and (3 are positive and the explanatory variable Xi can take values in 
(0,xo] for some xq. Some results on optimal designs [e.g., Dette and Wong 
(1999)] are available for this model. The information matrix for (a, (3) is 
again of the form given in (2.1) and (2.2), this time with the choices A(a, (3) = 



Co /a i/iS), a = ax i/(P + Xi), *i(ci) = cf, y 2 {a) = 4 and V 3 (a) = c\. 



Our strategy is to identify a class of designs so that for any design £, and 
for given a and /3, there is a design £* in the class with (a, (3) > C^(a, (3). 
This inequality in the Loewner ordering implies the same inequality for 
the corresponding information matrices in (2.1), and £* is, for these (a,/3), 
locally better than £ under commonly used optimality criteria, such as <J> P - 
optimality, which includes D-, A- and E'-optimality. Moreover, if the interest 
is not in (a, (3) but in some one-to-one transformation of these parameters, 
say (ti, T2), then £* is also better than £ in the Loewner ordering for (ti,T2). 
This follows easily by observing that the information matrix for (ti,T2), say 
J^(ri,T2), can be expressed as Jg(ri,T2) = (B T (a, (3))~ l I^{a, f3)B~ l (a, (3), 
where I^(a,f3) is as defined in (2.1) and 



Observe that this also implies that £* is better than £ for r\ if that is the only 
parameter function of interest. For this strategy to be useful, the class of 
designs that we identify must, of course, be a relatively small class consisting 
of designs that have a small support size. 

3. The main tools. The main algebraic tools are derived in this section 
assuming certain properties for the ^j's in (2.2). Applications to specific 
models will be considered in Sections 4 and 5. We start with the following 
lemma. In Lemma 1, as well as in Proposition A.l in the Appendix, B could 
be +00, but A and the c's must be finite. 

Lemma 1. Assume that ^i(c), ^(c) o.nd ^(c) are continuous func- 
tions on [A,B\, that they are three times differ entiable on (A,B] and that 
they satisfy the following conditions on the latter interval: 





B(a,f3) 



da 
V da 



(a) * / 1 (c)<0; 



(b) ($f)'>0; 

(c) ((|i)'/(tMyy>o; 

(d) lim 4A ^(* 1 (A)-* 1 (c)) = 0. 
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Then, for any c\ and c 2 with A < c\ < c 2 < B and < u < 1, there exists a 
unique pair c x ,uj x , where c x G (01,02) and < u x < 1, such that 

(3.1) W*i(ci) + (1 - w)Vl(c2) = Ux^l{A) + (1 - W x )* l(Cz), 

(3.2) wtt 2 (ci) + (1 - u;)^ 2 (c 2 ) = cu^ 2 (A) + (1 - w 4 )f 2 (ci) 
and 

(3.3) w* 3 (ci) + (1 - w)* 3 (c 2 ) < u x * 3 (A) + (1 - Wa-J^aCcx). 

For w = or 1, /or c x G [ci,c 2 ], i/ie unique pair that gives equality in (3.1) 
and (3.2) is c x = C2 or c\, respectively, and uj x = 0. This solution also gives 
equality in (3.3). Furthermore, c x is a strictly decreasing function ofu. 

Proof. If u = or 1, then it follows from (A.l) and condition (a) that 
c x = c 2 or ci, respectively, and uj x = 0. This obviously also gives equality in 
(3.3). 

Next, let < uj < 1. We will first show that there is a unique pair c x G 
(ci,c 2 ) and to x G (0,1) that satisfies (3.1) and (3.2). For cG (ci,c 2 ), define 

/o A ^ , , A ^i(ci) + (l-a;)^i(c2)-^i(c) 
(3 - 4) ^ (C) = *i(A)-* l(c ) ' 

Notice that u>a(o) is an increasing function of c by observing that 1 — oja(o) 
is a decreasing function of c. For any c G (ci,c 2 ), (3.1) holds for (c^Wa,) = 
(c,ua(c)) [although uj x may not be in (0,1)]. Define 

Fi(c) = u A {c)m 2 {A) + (1 - wa(c))¥ 2 (c) - cj^ 2 (ci) - (1 - cj)* 2 (c 2 ) 

^(cO + q-^i^)-^^) _ 

-*i(c) 1 21 ' 2[ >> 

+ * 2 (c) - w* 2 (ci) - (1 - w)* 2 (c 2 ). 

For c = ^f 1 (w^'i(ci) + (l-a;)^'i(c 2 )) [^J -1 exists and c G (ci,c 2 ) since *i(c) 
is a monotone function by condition (a)], 

(3.5) Fi(c) = # 2 (c) - w¥ 2 (ci) - (1 - u;)^ 2 (c 2 ) > 0, 

where we have used (A.l). On the other hand, for c = c 2 , we have 

Fl(c) = "*i(A)-ZtoT { * 2{A) " ^ 2(C2)) " ^ 2{Cl) " ^ 2(C2)) 



(3.6) =u 



^l(ci)-^(c 2 ) 
^(A)-*!^) 21 j 

<0, 



^(A)-^( C1 ) 
+ * 1 (A)-^ 1 (c 2 ) W2iC2j W2lClj 
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where we have again used (A.l) in the last step. Since -Fi(c) is a continu- 
ous function, by (3.5) and (3.6) there must be a c x € (^J~ 1 (u;^' 1 (ci) + (1 — 
w)^i(c2)), C2) so that F\{c x ) = 0. Then c x and loa{c x ), which we will abbre- 
viate to u x , satisfy (3.1) and (3.2). Note that u x S (0,1) for this choice. 

We will now show that the pair (c x ,uj x ) is unique. Assume that (c y ,uJA(cy) - 
Ljy) is another pair that satisfies (3.1) and (3.2). Without loss of generality 
we may take c x < c y . By (3.4), this implies uj x < u y , so that < W ^Z^ X < 1- 
Since both (c x ,uj x ) and (c y ,ujy) satisfy (3.1), we have that 

(3-7) = ^f^*!(A) + \^^{Cy). 

1 — UJ T 1 — U> T 



U y ~ , T , ( A\ 1 1 



By (A.l) this implies 

(3.8) * 2 (^) > ^_Jr£$ 2 (A) + ^-^* 2 (c,,). 

But since both (c x ,u; x ) and {c y ,u y ) satisfy (3.2), we also have 

(3-9) * 2 (c,) = ^^^{A) + ^Mcy), 

1 — u> x 1 — UJ X 

which contradicts (3.8). 

The next step consists of showing that the unique pair (c x ,to x ) also sat- 
isfies inequality (3.3). Prom (3.1) and (3.2), we obtain 

LJ = ((¥1(0 - *l(c2))(* 2 (Cx) " * 2 (A)) - (^2(C X ) ~ * 2 (C 2 )) 
X [(*l(ci) - *l(c2))(* 2 (Cx) - * 2 (A)) 

- (* 2 (ci) - tf 2 (c2))(*i(c«) - ^i(^))]" 1 and 
= ((*i(ci) - *l(pa))(*2(Cx) - * 2 (c 2 )) 

- (* 2 (d) - * 2 (c2))(*l(cb) - *l(c 2 ))) 

x [(*i(ci) - *i(c2))(* 2 (Cx) - * 2 (A)) 

- (* 2 (ci) - * 2 (P2))(*l(Cx) - ^l(^))]" 1 . 

Note that the common denominator in these expressions is positive by (A. 3). 
Then inequality (3.3) is equivalent to (A. 4), and the conclusion follows. 

For the final step of the proof we establish that c x is a strictly decreasing 
function of uj. For fixed c\ and c 2 , we have just established that for every uj G 
(0, 1) there exists a unique c x , such that (3.1), (3.2) and (3.3) are satisfied. 
As seen in (3.10), we can express a; as a function of c x . This expression also 
appears in (A. 5), and we conclude from (v) of Proposition A.l that uj is 



(3.10) 
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a strictly decreasing function of c x , which implies also that c x is a strictly 
decreasing function of uj. □ 

The assumptions in Lemma 1 are sufficient to reach the conclusions of the 
lemma, but certain modifications of the assumptions, which are useful for 
later applications, can yield the same or similar conclusions. The next two 
lemmas present variations on Lemma 1. Before we formulate these lemmas 
we first introduce new terminology. We say that (^i(c), ^(c), ^(c)) are 
functions of type / on [A, B] if 

(i) x I / i(c), ^(c) and ^3(6) are continuous functions on [A, B] that are 
three times differentiable on (A,B]; 

(ii) *i(c)(^) / ((J^)7($$)0' <0 (A,B]; and 

(iii) hm cM |^(* 1 (A)-* 1 (c)) = 0. 

Here B could be +00, but A must be finite. We say that (^(c), ^(c), 
^3(0)) are functions of type II on [A, B] if 

(i) ^i(c), ^(c) and ^3(0) are continuous functions on [A, B] that are 
three times differentiable on [A, B) ; 

(") *iW(|p) / ((|^)7(|fg) , )'>0 for cG [A,B); 

(iii) Iim cTB J^(* 1 (S)-* 1 (c)) = 0. 

In this case A could be —00, but B must be finite. The conditions for 
functions of type I and type II can generally be verified easily; for example, 
by using symbolic computational software, such as Maple. 

Suppose conditions (c) and (d) of Lemma 1 are met, but ^(c) > and 
( ^(c) )' ^ 0- It is easily seen that — ^i(c), ^(c) and ^3(0) satisfy all con- 
ditions of the lemma, so that Lemma 1 holds for — 'I'i(c), ^(c) and ^(c). 
But since (3.1) is an equality, this means that the conclusions of Lemma 1 
hold for ^i(c), ^(c) and ^3(0). Application of Lemma 1 with ± 1 I / i(c) or 
±^2(c) yields the following conclusion: 

Lemma 2. // (^i(c), ^(c), ^3(0)) are functions of type I on [A,B], 
then the conclusions of Lemma 1 still hold. 

If (*i(c), ^(c), ^3(0)) are functions of type II on [A,B], define $i(c) = 
\&i(-c) L $ 2 (c) = ^(-c) and $ 3 (c) = ^ 3 (-c). It can be verified that ($i(c), 
^(c), ^(c)) are now functions of type I on [-B, —A]. For any A < c < B, 
\Pl(c) = ^i(c), where c = — c€ (— B, — A], Thus, by applying Lemma 2, we 
have the following result: 
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Lemma 3. Suppose (^i(c), ^(c), ^3(0)) are functions of type II on 
[A, B] . For any given A<c\<C2<B and < u < 1, there exists a unique 
pair c x ,uj x , where c x G (01,02) and u x G (0,1), such that (3.1), (3.2) and 
(3.3) hold with A being replaced by B. 

Lemmas 2 and 3 are the basis of this algebraic method. The following 
two corollaries will be used in our main results. The first one can be derived 
immediately from Lemma 2. 

Corollary 1. Let (^>i(c), $2(0), ^3(0)) be functions of type I on 
[A,B]. For any given A < c\ < c 2 < B, u% > 0, and w 2 > 0, there exists 
a unique pair c x ,u X) where c x G (01,02) and u> x G (0,u>i + w 2 ), such that 

wi*i(ci) +w 2 *i(c 2 ) = u x ^ 1 (A) + (u 1 +u 2 -u; x )^ 1 (c x ), 

Wl* 2 (ci) + W 2 # 2 (c 2 ) =0J X ^2(A) + (Wl +LU 2 ~ CJ x )^ 2 (c x ) 

and 

wi*3(ci) + ^3(02) < uj x ^ 3 (A) + (Wl +UJ2- uj x )^ 3 (c x ). 
Applying Corollary 1 repeatedly, we obtain the following result: 

Corollary 2. Let (^i(c), ^ 2 (c), ^3(0)) be functions of type I on 
[A,B], Let Ci G (A,B\ and Ui > 0,i = 1, ...,k, k > 2. Then there exists a 
unique pair c x ,u x , where c x G (A,B) and oj x G (Q,Yut=i UJ i) , such that 



(3.11) 



k / k \ 

^Wi*l(Ci) = LO x ^l(A) + I J^Ui - U) x J $i(c x ), 
i=l \;=1 / 



(3.12) ^Wi$ 2 (ci) =w x ^ 2 (^) + ^^-^^(cx) 
i=l M=l ' 

and 

k I k \ 

(3.13) 5^w i * 3 (c()<a; a .*3(il)+ I - pafee). 
j=i \j=i / 

Similarly, Lemma 3 yields the following result: 

Corollary 3. £e£ (^i(c), ^ 2 (c), *3(c),) 6e functions of type II on 
[A, B]. Let Ci G [A, B) and Ui > 0, i = 1, . . . , k, k > 2. TTten i/tere exists a 
unique pair c x ,u x , where c x G (A, £>) and a; x G (0,5Zi=i^i)) snc/i t/iai 
fc / k \ 

^W^l(Q) = W^l(B) + I J] Wi - U3 X \ ^i(c x ), 
i=l \i=l J 
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and 



k / k 

i=l \i=l 

k I k 

t=l \i=l 



4. Application to (2.3). For (2.3) we have that *i(c) =*(c), *2(c) = 
c\I>(c) and ^ 3 (c) = c 2 ^(c), where \I>(c) = (jj^p for the logistic model, *(c) = 

$( c )(i-$(c)) ^ or ^ e Profit model, ^(c) = 2g | c 1 | _ 1 for the double exponential 
model and Vl/(c) = (i + | c |):/(2|c|+i) fo r t ne double reciprocal model. Here, $(c) 
and </>(c) are the c.d.f. and p.d.f. for the standard normal distribution. We 
observe that all four ^(c)'s are even and positive functions. By routine al- 
gebra, it can be shown that in each case (^i(c), ^ 2 (c), ^(c)) are type I 
functions on [A, B] whenever < A < B, including [0,oo). In addition, for 
the logistic and probit models, for c > it also holds that 



(4.D [«>0. 



*i(c) 

We will use these properties in the derivations of the key results in this 
section. 

We will distinguish between two possible types of constraints on the values 
of the Cj's. For a symmetric constraint we will assume that Cj € [—D,D] for 
some D > 0, while Cj G [Di,D 2 ], where \Di\ ^ \D 2 \, f° r a nonsymmetric 
constraint. For the special case that D = 00, there is no constraint at all 
on the q's; if either D\ = —00 or D 2 = 00, then there is only a one-sided 
constraint. We need the following lemma: 

Lemma 4. Consider (2.3) for the logistic, probit, double exponential or 
double reciprocal model. Assume Ci G [D\, D2] where D\ < < D 2 . For an ar- 
bitrary design £ = {(cj,Wj),z = 1, . . . ,k}, there exists a design £ = {(c + ,u; + ), 
(c~ (0, 1 — to + — uj~)}, such that Cg < C~ under the Loewner ordering. 

Here, < c+ < D 2 and Di < c~ < 0. 

Proof. Consider all positive q's. If there are none, take c + as any point 
with < c + < D 2 and uj + = 0. If there is one such Cj, take this as c + and take 
uj + to be the corresponding For two or more positive q's, by Corollary 2 
there exist (c + ,uj + ) and u>io, such that 

c t >0 
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UiCi^(Ci) = w + c+*(c+), 

C;>0 

J2uJ i c^(c l )<u + [c + } 2 ^(c + ). 

C;>0 

Here, < c + < D2 and o>io + w + = XIc >o w i- Since ^(c) is even, a similar 
result holds for negative Cj's, if any. Let the corresponding values be (c~ ,uj~), 
where D\ < c~ < 0. Let £ = (c + ,u; + ), (c~, (0, 1 — uj + — uj~). Comparing 
the two information matrices and C~, we can see that all elements are 
the same except that the last diagonal element of the latter exceeds that of 
the former unless £ = £. The conclusion follows. □ 

Theorem 1. Let £ = {(ci,Ui),i = 1, ...,k} with k>2 and with ci G 
[— D,D] for some D > 0. Then, for the logistic or probit model in (2.3), 
there is a design £* based on two symmetric points with < Cg* . For the 
double exponential and double reciprocal model, the same conclusion holds 
except that a third point, namely 0, may have to be included in the support 
ofC- 

Proof. We first prove the result for the double exponential and double 
reciprocal models. With £ as defined in Lemma 4, it is sufficient to show that 
there exists a design £* with a support that is based on two symmetric points 
plus the point and with C^< C^* . Since Cj G [— D, D] , we have c + < D and 

— c~ < D. If c + = — c~ , then we take = £ and the conclusion follows. 
Otherwise, consider the pair {(c + , (— c~,ui~)} and recall that ^(c _ ) = 
^/(— c~). Applying Corollary 1, there exists (c x ,lo x ), with c x between — c~ 
and c + , such that 

ur*(-c - ) + lo + ^(c + ) = (uj~ + lo + - u x )V(0) 

(4.2) 

-oj c ^(-c )+uj + c + ^(c + )=uj x c x ^{c x ), 
u-[-c-] 2 ^(-c-)+u+[c+] 2 ^(c+)<iv x cl^(c x ). 

It is clear that c x < D. Define 

_ Ld~C~$>(c~) + U) + C + ^>{c + ) 

P ~ -uj~c~^{-c~) +uj + c + ^{c + ) 

Observe that < p < 1. Let = {(c x ,piv x ), {-c Xl (1 - p)u x ), (0, 1 - u x )}. 
Using (4.2) and that is even, it follows that the corresponding elements 
of Cj and C^* are equal, except that the last diagonal element of C^* could 
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be larger than that of C~. Therefore C~ < , and the conclusion follows 
for the double exponential and double reciprocal models. 

These arguments are also valid for the logistic and probit models. There- 
fore, with £* as the design just constructed, for these models it suffices 
to show that there exists a design £° based on two symmetric points only 
such that C%* < C^o. Since (4.1) holds for the logistic and probit models, by 
Proposition A. 2 there is a unique c x q such that 

V(cxo) = (1 - w x )*(0) + (<*), 

(4-3) 

[cxo] 2 y(c x0 ) > uj x [c x ] 2 y{c x ). 
Moreover, from (A.l) it follows that 
(4.4) c x0 ^{c x0 )>uj x c x y{c x ). 
Define 

2 ^ = u x {2p-l)c x ^(c x ) 1 
c x0 ^(c xQ ) 

Observe that oj x q G (0, 1). Let £° = {(c x q,u x o), (—c x q, 1 — w x o)}- The conclu- 
sion follows now as before. □ 

Almost all results on optimal designs for (2.3) that are currently avail- 
able in the literature are for the situation that there is no restriction on 
the design space. For example, for (a//3,/3), optimal designs are found in 
Abdelbasit and Plackett (1983) and Minkin (1987) (.D-optimality); 
Ford, Torsney and Wu (1992) (c- and D-optimality) ; Sitter and Wu (1993a, 
1993b) (A- and F-optimality) and Sitter and Forbes (1997) (optimal two- 
stage designs). Mathew and Sinha (2001) provided a unified algebraic ap- 
proach for the logistic model for deriving A-, D- and .E-optinial designs. 
For (a, (3), Dette and Haines (1994) investigate E'-optimal designs, while 
Mathew and Sinha (2001) obtained ^4-optimal designs for the logistic model 
under the restriction of symmetry, which was removed by Yang (2006). All 
these results show that optimal designs are based on two symmetric support 
points for the logistic and probit models, with as a possible additional 
support point for the double exponential and double reciprocal models. The- 
orem 1 unifies and extends these results. For example, from Theorem 1 it 
follows that such results hold as long as the design space is symmetric, for 
other functions of a and (5, and under more general optimality criteria. We 
note that Yang (2006) showed that an ^-optimal design for (a,/3) for the 
double exponential and double reciprocal models could be based on two sym- 
metric points only; this does not contradict Theorem 1, but simply shows 
that the weight at the point could sometimes be for an optimal design. 

The next result shows that for all four models, we can restrict attention 
to designs with only two support points if the design region is entirely at 
one side of the origin. 



LOCALLY OPTIMAL DESIGNS 



13 



Theorem 2. Let £ = {(ci,u>i),i = 1, ...,&} with k>2 and with ci G 
[Z?i,L>2] where either D\ > or L>2 < 0. T/ien, /or £/ie logistic, probit, double 
exponential or double reciprocal model in (2.3), there is a design £* based on 
two points with < C^* , and one of the two support points can be taken as 
Di ifD l >0 or as D 2 if D 2 < 0. 

We skip the proof since the arguments are similar to those resulting in 
Lemma 4. 

The next result covers the design regions not covered by Theorems 1 
and 2. 

Theorem 3. Let £ = {(ci,uJi),i = 1, ...,k} with k>2 and with Ci G 
[Di,D 2 ], where D\ < < D 2 and —D\ ^ D 2 . Then for the logistic or pro- 
bit model in (2.3), there is a design £* based on two support points with 
< C^* . Moreover, the support points of £* are either two symmetric 
points; or, if —D\ < D 2 , D\ and a point in {—D\,D 2 ]; or, if —D\ > D 2 , 
D 2 and a point in [D\,— D 2 ). The same conclusion holds for the double ex- 
ponential or double reciprocal model, except that may have to be used as a 
third support point. 

The strategy for a proof of Theorem 3 is not unlike that for Theorem 1, 
but the details are more onerous and are presented in the Appendix. 

While optimal designs for a constrained design space are of great practical 
value, there are few published papers on this topic. Biedermann, Dette and Zhu 
(2006) studied $ p -optimal designs for (y/\a/j3, a/1 — A/?) for < A < 1 un- 
der (2.3). They showed that when the constrained design space is symmetric 
about 0, then, for the logistic and probit models, the support for an opti- 
mal design consists of two symmetric points. For a design space that is 
not symmetric, depending on the values of D\ and D 2 , the support points 
could consist either of two symmetric points or of two points with the one 
with a smaller absolute value being D\ or D 2 . Theorem 3 confirms this. 
Biedermann, Dette and Zhu (2006) further showed that one or both of the 
support points are end points when the end points are within a certain range. 
This also could be done using our approach. On the other hand, Bieder- 
mann, Dette and Zhu's (2006) approach worked for complementary log-log 
and skewed logit models, while our approach can handle double exponential 
and double reciprocal models. 

For complementary log-log and skewed logit models, the corresponding 
^(c) is not an even function. The arguments in Theorems 1 and 3 can 
therefore not be applied for these two models. However, Corollaries 2 or 3 can 
be applied for certain design spaces. For example, using ^(c) = exp (exp( 2 e C ))-i 
for the complementary log-log model, with Maple we find that (^(c), c^f(c), 
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(?"fy(c)) are type II functions for c G (— oo,co) and type I functions for c G 
(co,ci] or c G (ci,oo). Here cq, which is around 0.0491, is the point at which 

(( {C V(f' y/( { % { (c)' yy = and c i> which is around 0.4660, is the point at 
which ^'(c) = 0. From Corollary 2 or 3, it follows that for any constrained 
design region within one of the intervals above, all optimal designs are based 
on two points and one of them is either the lower or upper end-point. (Note 

that (^ipT^y-)' does not exist when c = c\, so that we must separate the two 
intervals (co,ci] and (ci,oo).) 

5. Application to (2.4), (2.5) and other models. For (2.4) we have that 
^i(c) = e c , ^(c) = ce c and ^(c) = c 2 e c . It is easy to show that (^i(c), 
^(c), ^(c)) are type II functions on [D\, D2] for any D\ < D2. By Corollary 
3, we immediately have the following result: 

Theorem 4. For (2.4), suppose that £ is a design with support in the 
design region [Di,!^] for some D\ < D2 < 00. Then there is a design £* 
with its support based on two points, one of which is D2, so that < C^*. 

By using the geometric approach, Ford, Torsney and Wu (1992) identified 
c- and D-optimal designs under (2.4). They showed that an optimal design 
has two support points and that one of them is D2. Minkin (1993) studied 
optimal designs for 1//3 under the same model. In our notation, he assumed 
(3 < and used the design space (— 00, a]. He concluded that the optimal 
design has two support points, and that one of them is a. Theorem 4 confirms 
and extends these results. 

For (2.5) it is easily seen that ^i(c) = c 2 , ^(c) = c 3 and ^3(0) = c 4 . It 
can be shown that (^i(c), ^(c), ^3(0)) are functions of type II on [Di,D2] 
if < D\ < Z?2- By Corollary 3, we obtain the following result: 

Theorem 5. For (2.5), suppose that £ is a design with support in the 
design region [D\, D2], < D\ < D2 < 00. Then there is a design with its 
support based on two points, one of which is D2, so that Cg < C^* . 

In our notation, with the design space (0, axo/(P + xo)], Dette and Wong 
(1999) identified D- and E'-optimal designs for (a,/3) under (2.5) that are 
two-point designs, with one of them being axo/((5 + xq). Therefore, Theo- 
rem 5 confirms and generalizes these results. Other work on this model can 
be found in Dette and Biedermann (2003). 

Our approach can also be applied to other models. Each time we need 
to check whether (^i(c), ^(c), ^(c)) are functions of type I or type II 
on an appropriate interval. We will illustrate this for a few examples here. 
For all of these examples, the information matrix for (a,f3) can be written 
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as in (2.1) with *i(c) = \P(c), ^(c) = c*(c) and ^3(0) = c 2 ^(c) for some 
function ^(c). 

Ford, Torsney and Wu (1992) also studied c- and D-optimal designs for 
the case ^(c) = c m and the design region \D\,Dq\ for < D\ < D2 < 00. 
They considered the cases (i) m > 0; (ii) —2 < m < 0; and (iii) m < —2. 
For cases (i) and (ii), except for m = 0, — 1, and —2, it is easily seen that 
( x I / i(c), ^(c), ^(c)) are functions of type II, while they are of type I for 
case (iii). Thus, based on our results, we find that optimal designs for cases 

(i) and (ii), except m = 0, —1, and —2, can be based on two support points, 
one of them being D2; for case (iii) the same conclusion holds, except that 
D\ is now one of the support points. We can further show that, for case 

(ii) , except for m = 0,-1, and —2, the two support points can be taken 

as D\ and D2. This can be done by verifying that ^(cX ^/ 1 ^ )' > and 

^2( c )( vj)' i (cj ) / > and applying (A. 16) of Proposition A. 3. When m = 0, —1, 
or —2, then one of *$>i(c), ^(c), or ^(c) is constant. The problem becomes 
simpler in that case, and by applying (A. 16) of Proposition A. 3 we can show 
that an optimal design can be based on D± and D2. Thus this conclusion 
holds for all m in case (ii). This confirms and extends the conclusions of 
Ford, Torsney and Wu (1992) for c- and D-optimal designs (their Tables 2 
and 3). 

Hedayat, Yan and Pezzuto (2002) identified ooptimal designs based on 
two symmetric points for a nonlinear model with ^(c) = (i+exp 2 (c)) 4 ' 
Hedayat, Zhong and Nie (2004) showed that D-optimal designs can be based 
on two symmetric points for a class of two-parameter nonlinear models that 
includes the following three examples: (i) ^(c) = (1 + c 2 )~ m , m > 1; (ii) 
qr(c) = e~ c2 ; and (iii) ^(c) = (s + tc 2 ) m e~ lc2 , s,t,l> 0, and m = 0orm<-l. 
All of these ^(c)'s are even functions that satisfy the conditions of Lemma 1 
as well as (4.1). Thus they have the same properties as the functions for the 
logistic and probit models, and the conclusions of Theorems 1, 2 and 3 
also hold for all of these models. This confirms and extends the results of 
Hedayat, Yan and Pezzuto (2002) and Hedayat, Zhong and Nie (2004). 

For any nonlinear model, if the corresponding functions ^i(c), ^(c) and 
^(c) are three times differentiable (which is a condition that is often met), 
then we may be able to identify intervals so that in each interval (^i(c), 
^(c), ^(c)) are functions of either type I or type II. If the constrained 
design space falls entirely within one of the intervals, then either Corollary 2 
or 3 can be applied to conclude that an optimal design can be based on two 
points, with one of them either the lower or upper endpoint of the design 
region. For example, Hedayat, Yan and Pezzuto (1997) studied D-optimal 
designs for a nonlinear model with ^ (c) = ^i^^^)y 2r +' 2 ^ or r > ^- ^5 as an 
example, we take r = 0.5, then it can be shown that (^(c), c\&(c), c 2l ^(c)) 
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are functions of type II for c £ (— oo,co) and that they are functions of type 
I when c£ (co,ci] and cG (ci,oo). Here Co, which is around —0.9131, is the 

solution to (( ^g7T?) )V( ^(c)^ )0 / = an d ci, which is around —0.6931, is 
the solution to *'(c) = 0. 

6. Discussion. By Caratheodory's theorem [cf. Silvey (1980)], for a non- 
linear model with two parameters, there is an optimal design that is based on 
at most three support points. However, identifying such points is very chal- 
lenging. Most studies in this direction are based on the geometric approach, 
following the seminal work by Elfving (1952), or, especially for D-optimal de- 
signs, variations on the equivalence theorem by Kiefer and Wolfowitz (1960). 
Unlike many of these studies, our approach yields very general results that 
go beyond solving problems on a case by case basis. It helps to identify the 
support of locally optimal designs for many of the commonly studied mod- 
els and can be applied for all of the common optimality criteria based on 
information matrices. It works both with a constrained and unconstrained 
design region and the conditions needed to reach the conclusions formulated 
in this paper can be easily verified using symbolic computational software 
packages. 

It is also worthwhile to note that this approach is of value for multi-stage 
experiments, where an initial experiment may be used to get a better idea 
about the unknown parameters. At a second or later stage, the question 
then becomes how to add more design points in an optimal fashion. If d\ 
denotes the design used so far and cfe the design to be used at the next 
stage, then the total information matrix is + Cd 2 ■ Since the first matrix 
is fixed, an optimal choice for the second matrix (in the Loewner ordering) 
is equivalent to making an optimal selection if there had been no prior 
information through design d\. Therefore, the results in this paper can be 
used to select d,2 by simply ignoring d\. 

While the results of this paper are far reaching, we believe that there is 
potential to extend the approach to nonlinear models with more than two 
parameters. There are currently very few results on this important practical 
problem. For example, in a dose-response study, in addition to an explana- 
tory variable x, the subjects might be grouped according to race, age, gender, 
etc. A better model would use these factors to account for heterogeneity in 
the response between the different groups. We are working on developing 
tools and results for such problems. 

Once the support points for an optimal design have been narrowed down 
by the methods of this paper, finding an optimal design is a relatively easy 
problem since we need to consider only the simple structure stated in our 
results. At worst, a numerical search will now be feasible, but in many cases 
an analytical solution can be obtained. For example, for the logistic model 
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under (2.3) with a symmetric design region, Mathew and Sinha (2001) con- 
jectured that there is an A-optimal design for (a, (3) that has two symmetric 
points as its support. Yang (2006) proved this conjecture using a compli- 
cated and tedious algebraic approach. However, by our new approach, this 
result follows immediately and we can easily find such an A-optimal design. 

For the results with (2.3) and a design region that includes the origin in its 
interior, we relied on the Vl/(c)'s being even functions. We have indicated in 
Section 4 how partial results can be obtained for the complementary loglog 
and skewed logit models. Whether our approach can be used to provide 
complete answers for such models remains an open question. 

APPENDIX 

Proposition A.l. Let ^i(c), ^ 2 (c) and ^(c) be functions that satisfy 
the assumptions and conditions formulated in Lemma 1. Then, for fixed 
c\ and c 2 with A < c\ < C2 < B and any c 6 (A,B] and c x £ (ci,c 2 ), the 
following properties hold: 

(i) For any uj £ (0, 1), if *i(c) = uj^i^) + (1 - w)#i(c 2 ), then 

(A.l) # 2 (c) >w* 2 (ci) + (1 -w)# 2 (c 2 ). 

This statement remains valid if we allow c\ = A. 
(") 

%(c) ^2(A) - v& 2 (c) 
1 ' ' ^ 1 (c) > * 1 (A)-^ 1 (c)- 

(iii) 

(^i{c l )-^ l (c 2 )){m 2 {c x )-^ 2 (A)) 

(A.3) 

- (* 2 (ci) - ^ 2 {c 2 ))(^ 1 {c x ) - *i(A)) > 0. 

(iv) 

F 2 (A,c 1 ,c x ,c 2 ) 

:= [* 3 (ci) - * 3 (c2)][(*i(cx) - ^i(c 2 ))(^> 2 (c x ) - ¥ 2 (A)) 

- (V 2 (c x ) - * 2 (P2))(*i(c iB ) - *i(A))] 
- [* 3 (A) - tt 3 (c*)][(*i(ci) - *i(c 2 ))(* 2 ( C;E ) - * 3 (ca)) 

(A.4) 

- (* 2 (ci) - *2(c 2 ))(*l( C:r ) - *1(C2))] 
+ [* 3 (c 2 ) - ^ 3 (Cx)][(^l(ci) " *l(c 2 ))(^ 2 ( Ca; ) - tf 2 (A)) 

- (* 2 (ci) - ^ 2 (c 2 ))(^ 1 (c x ) - *!(A))] 

<0. 
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(v) 

((^i(c,0 - ^iMX^c*) - * 2 (^)) 
- (tf 2 (c x ) - ^ 2 (c 2 ))(^i(c x ) - *i(A))) 

(A.5) 

x [(*i(ci) - *i(c 2 ))(* 2 ( C:K ) - * 2 (A)) 
- (* 2 (ci) - ^ 2 (c 2 ))(^i(c a; ) - ^i(^))]" 1 
is a strictly decreasing function of c x . 

Proof, (i) Fixing c\ E [A, B) and u; E (0, 1), from condition (a) it follows 
that for every c 2 E [c\,B\ there is a unique c E (ci,c 2 ) so that *i(c) = 
w*i(ci) + (1 — u;) l I / i(c 2 ). Thus, keeping c\ and fixed, we can view c as a 
function of c 2 . We have 

(A.6) * / 1 (c)^- = (l- W )«' 1 (p a ). 

ac 2 

Define 

Gi(c 2 ) = * 2 (c) - cj^ 2 (ci) - (1 - cj)* 2 (c 2 ). 
Using (A.6), we obtain 

G' 1 (c 2 ) = %(c)— -(1-cj)%(c 2 ) 
dc 2 

(A.7) 

Since c < c 2 , from conditions (a) and (b) we conclude that Gi(c 2 ) > for 
c 2 > c±. The result follows by observing that lim C2 j cl G\(c 2 ) = 0. 

(ii) Define 

G 2 (c) = " *i(c)) - (*a(i4) - * 2 (c)). 

Then G 2 (c) = ( JM|)'(*i(>1) - *i(c)), so that G' 2 (c) > by (a) and (b). 

Since lim c |AG' 2 (c) = by (d), it follows that G 2 (c) > 0, which is equivalent 
to (A.2). 

(iii) Define 

G 3 (C 1 ,C X ,C 2 ) = (*l(ci) - *l(Q2))(*2(p*) - ^2{A)) 

- (* 2 (ci) - * 2 (c 2 ))(*i( C:r ) - 
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For c 2 > c x we have that 
dG 3 (ci,c x ,c 2 ) 



*'l(c2)(*lter)-*l(^)) 



dc 2 
(A.8) 



*i(c2) tti(A)-*i(ci 



>0. 



The inequality in (A.8) follows from conditions (a) and (b) and (ii) of this 
proposition. The result follows if we show that Gi(ci,c x ) := G 3 {c\^c x ,c x ) > 
for c x > c\ . It is easily seen that G4 (ci , ci) = and 



By the same argument as for (A.8), we conclude that dGi{c\,c x ) /dc x > 0, 
which implies that G±(c\,Cx) > and yields the desired result. 

(iv) Since F 2 (A, c±, c x , c x ) = 0, it suffices to show that ®E*!A]£h£si2il < 0. 
But 

dF 2 (A,cuc x ,c 2 ) = ^ (c2)[( ^ (ci) _ McxmiiA) _ y l{Cm)) 

+ (*2(Cx) ~ *2(^))(*i(ci) - *l(Cz))] 
+ * 2 (C 2 )[(* 3 (C1) " ^(Cx))^!^) " 

+ (tfgfe) " * 3 (^))(^l(Cx-) " *l(ci))] 

+ * / 1 (c 2 )[(^ 3 (ci) - V 3 {c x ))(V 2 (A) - ^ 2 (c x )) 

+ (* 3 (c x ) - * 3 (A))(^ 2 (ci) - * 2 (^))]. 

This expression is when c x = c% , so that it suffices to show that - ^g^^ 2 ^ < 
0. But 

d 2 F 2 (A,d,c x ,c 2 ) 
dc 2 dc x 

= *3(ca)[*2(cx)(*i(ci) - + y[(c x )(* 2 (A) - * 2 (ci))] 

+ * 2 (c2)[^ 3 (c a; )(*i(^) - *i(ci)) + *ife)(*3(ci) - * 3 (-A))] 
+ %(c 2 )[%(c x )(y 2 ( Cl ) - tf 2 (A)) + * 2 ( Cs )(* 3 (^) - *a(ci))]. 

This expression is for ci = A, so that it suffices to show that - F q^q^Qc^ < - 
0. Simple computation gives 

+ *! 1 ( C2 )[*' 1 fe)^(c 1 )-<pyc,)*' 1 ( Cl )] 
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+ ^ 1 ( C2 )[^( C;E )M/' 2 ( Cl )-^ 2 (c :c )M/ / 3( Cl )] 

*i (ci ) { Cx ) (c 2 ) f 3 (ci , c,, C2 ) , 



where 



, * 3 (c x )* 2 ( Cl ) ^(^(d) 



By condition (a), \Jj' 1 (ci)* / 1 (c a; )vE r/ 1 (c2) < 0. Thus we need to show that F%{c\, c x , 

(ci,c a 
9c2 



c 2 ) > 0. Since Fz(ci, c x ,c x ) = 0, it suffices to show that dFs ^' Cx ' C2 ^ > g. But 



— to* — = 1^)J F4(C1 ' C - C2) ' 



where 

((^ s fo))/(tfifo)))7^(*) * 2 (ci) 

^4{Cl,C x ,C2) ~ 



((* 2 (c 2 ))/(*' 1 (c 2 ))) / V*ife) ^i(ci) 



Co 



Using condition (b), it suffices to show that F±{c\, c x , c 2 ) > 0. But using that 
ci < c x < c 2 and conditions (b) and (c) , we obtain that 

F( {(%(c x ))/{%(c x )))' ( %{c x ) %{ Cl )\ 

41 U *' 2 ' ((%(c x ))/(^(c x )))' Uife) ^(ci)) 

( %( Cl ) %( Cx y 

+ Ui(ci) VUc). 

The latter expression is when c x = c\ , and by using (b) and (c) we can 
see that its partial derivative with respect to c x is positive. This yields the 
desired conclusion. 

(v) The expression in (A. 5) is precisely uj as defined in (3.10). It suffices, 
therefore, to show that dui/dc x < 0, which is equivalent to showing that 
d{j^j)/dc x < 0. But = Q fe%? } , where G 4 (c 1: c x ) is defined as in the 
proof of (iii) and 

G 5 (c 1 ,c x ,c 2 ) = (^i(c x ) - *i(p2))(* 2 (cb) - *2(A)) 

- (* 2 (cb) - *2(c 2 ))(^i(c a; ) - 

Clearly d( %fegft /dc a; < is equivalent to 

(A.9) — G ! 4(ci,c a; ) -G 5 (ci,c x ,c 2 ) — < 0. 
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Observing that 
dG 5 (ci,c x ,c 2 ) 



V'ticXVxiA) - *i(c 2 )) - ■Z>> 1 (c x )(y 2 (A) - * 2 (c 2 )) 



and using (A. 2) and condition (a), we see that 9G ^ c ^ Cx ^ < o when c 2 = c x . 
Since G§{c\,c x ,c x ) =0 and ^4(01, c x ) > 0, we see that (A. 9) holds when 
c 2 = c x . Hence, the result follows if we can show that the left-hand side of 
(A. 9) is a decreasing function of c 2 . Simple algebra shows that the partial 
derivative of the left-hand side of (A. 9) with respect to c 2 is 



%{c x ) ^ 2 (A)-^ 2 (c x ) 
%(c 2 ) * 2 (^)-* 2 (ci) 



(A.10) 

In (A. 10), ^(c^), ^i(c x ) — 1 3/i(^4) and ^1(02) are negative while other terms 
are positive [by (A. 2) and conditions (a) and (b)]. Thus (A. 10) is negative, 
which completes the proof. □ 

Proposition A. 2. Suppose that ^i(c) and ^(c) are continuous func- 
tions on [A, B] and that, for c G (A, B], they satisfy ^±{c) < and ( ^^j )' > 

0. Then, for any A < c\ < c 2 < B and u G (0,1), there exists a unique 
c G (ci, c 2 ) such that 

*i(c) =cj^i(ci) + (1 -w)*i(c 2 ) and 

(A.ll) 

* 3 (c) > w^ 3 (ci) + (1 - w)* 3 (c 2 ). 
Furthermore, c is a strictly decreasing function of u . 

Proof. Since ^1 is a strictly decreasing function, ^j -1 exists. Let c = 
^ , 5~ 1 (lo'^'i(ci) + (1 — a;) x I'i(c 2 )), then clearly c G (ci, c 2 ) and the first equation 
of (A.ll) holds. By the same argument as for (A.l), the inequality in (A.ll) 
holds. The uniqueness of c follows since ^1 is strictly decreasing. That c is 
a strictly decreasing function of a; is a consequence of c\ < c 2 and the fact 
that both ^1 and VP^" are strictly decreasing functions. □ 

We will now present a proof for Theorem 3. 

Proof of Theorem 3. Since the ^'s are even, it suffices to consider 
the case — D\ < D 2 . We will first prove the result for the double exponential 
and double reciprocal models. It suffices to show that there exists a design 
as in the statement of the theorem, say £*, that satisfies C-^< C^* , where £ = 
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{(c + ,u; + ),(c ,lu ), (0, 1 — uj + — to )}, < c + < Z?2 is the design in Lemma 4. 
With D = max{— c~,c + }, we obtain a design £q from Theorem 1 with C~< 

C^*. However, £q may not have its support in [D\,D2\. If c x in the proof of 
Theorem 1 is in [0, —D{\, then we can take £* to be £g. 

Suppose that this is not the case, so that — c~ < —D\ < c x < c + . By 
Corollary 2, the monotonicity of c x in Lemma 1 and its continuity, there 
exist < po < 1 and < uj\ < lu~ + w + po such that 

uj~$>(-c~) +uj + p ^(c + ) = {u~ +uj + p - ^i)^(O) 

+ wi*(- J Di), 

(A.12) 

-lo~c~^>(-c~) +w + p c + ^(c + ) = -uiDi^{-Di) : 
u-[-c-]H{-c-) +LU + Po [c + ]H(c + ) <wi[-£>i] 2 ¥(-.Di). 

Define 

u~c~ty(c~) +uj + p c + ^(c + ) 
1 -uj-c-^(-c) +uj + pqc + ^>(c+) 

Then < p± < 1, and the design £i = {(L>i,ui(l — pi)), (— Di,u±pi), (c + , 
— po))) (0, 1 — — po) — t^i)} has a larger information matrix than 

£. By applying Corollary 2, we can further improve the information matrix 
by replacing the points —D\ and c + by and a point c x £ (—Di,c + ). The 
resulting design with support points D\, c x , and can be taken as design 
£*, giving the conclusion for the double exponential and double reciprocal 
models. 

These arguments are also valid for the logistic and probit models. Thus, 
for these models, it suffices to show that there exists a design £° based on two 
symmetric points or on D\ and a point cq 6 (—D\,D^ so that Cg* < C^o, 
where £* is as in the first part of this proof. If the support of consists 
of the origin and two symmetric points in [D\,— D\], then by Theorem 1 
we can find a better design based on two symmetric points only. Thus the 
conclusion follows in that case. 

Suppose therefore that £* = {(0,u;o), (c x ,u> x ), (D±, 1 — too — u x )}, where 
c x > —D\. As in the proof of Theorem 1, there exists a c x q G (0,c x ) such 
that 

(coo + u x )^(c x0 ) = w ^(0) + u) x ^(c x ), 

and so that two inequalities similar to those in (4.3) and (4.4) hold. 

If c x q < —D\ . then by a similar argument as in the proof of Theorem 1 
we can improve design £* by replacing design points c x and with design 
points c x o and —c x q so that the information matrix is larger. The resulting 
new design is based on D\, —c x q, and c x q, and by Theorem 1 we can find a 
design with two symmetric points only that is at least as good. 
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If, however, c x q > —D\, by the monotonicity property in Proposition A. 2 
we use that there exists a p x G (0, 1), such that 

(cj + w&xWi-Di) = w ^(0) + u xPx *{c x ). 

Again by a similar argument as in Theorem 1, we can obtain a design, 
say £i, based on D±, —D\ and c x that is better than £*. Let u\ and u> x o be 
the weights for —D\ and c x , respectively, in £i. For any q, < q< 1, there 
exists a c^i G (— Di,c x ) such that 

(wig + w x0 )^(cxi) = wig*(-Di) +uj x0 ^(c x ), 

(A.13) (wig + Wa-o)^!*^!) > -WigDl^C-DlJ+WaoCi,.*^), 

(u iq + u^o)^*^) > wig[-Di] 2 *(-Di) + cj x0 c 2 x ^(c x ). 

For the two inequalities, equality holds only if q = 0. Form a new design, 
say £21 obtained by replacing (—Di,u;±) and (c x ,u} x o) with (Di,ui±(l — q)) 
and (cxi,u}\q + u x q). Comparing the information matrices for £1 and £2, by 
(A.13), for any q the first diagonal elements are the same and C^ 2 has a 
larger second diagonal element. The difference in the off-diagonal elements 
of the two matrices is given by 

(A.14) (u iq + *(c x i)+wi(2-g)£)i*(-Di) -u x0 c x i£(c x ). 

For q = 0, c x \ = c x and the expression in (A.14) is negative. For q = 1, by 
the second inequality in (A.13) the expression in (A.14) is positive. By the 
first equation of (A.13), c x \ is a continuous function of q. This implies that 
(A.14) is also a continuous function of q. So there exists a q G (0,1) such 
that (A.14) is 0. Let £° be as design £2 for that value of q. Then £° is better 
than £* and is based only on D\ and c x \. This completes the proof. □ 

Proposition A. 3. Suppose \l/i(c) and ^(c) are twice differentiable on 
[A, B] and satisfy 



(A.15) 




for all c G [A, B\. Then, for any c G [A, B], there exists an uj G (0, 1), such 
that 

*i(c)=w*i(A) + (l-w)*i(J3) and 

(A.16) 

*3(C)<W^ 3 (^) + (1-W)^3(5). 

Proof. If (A.15) holds, then either *i(c) > and (|f^y)' > or ^(c) < 
and ( ^?( e ) ) < 0. Since the second case can be reduced to the first by defin- 
ing x I / i(c) = — \&i(c), it suffices to consider only the first case. 
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Since ^(c) > 0, ^i(c) is a strictly increasing function on [A, B]. Define 
u = ^l(B)~^i(A) ■ Then < U) < 1 for any c G [A, B], and the equality in 
(A. 16) holds. We will show that the inequality in (A. 16) also holds. When 
c = A this is obvious. So take c > A. The inequality in (A. 16) is equivalent 
to G(A,c,B) > 0, where 

G(A,c,B) = (tf 3 (A) - * 3 {B)){*i(B) - *i(c)) 

(A.17) 

+ (* 3 (S) - * 3 (c))(*i(5) - tfiM). 

Since c, B) = when JB = c, it suffices to show that 8G(A, c, B) jdB > 0. 
But 

dG(A,c,B) ,,„.. , „^/^(-B) * 3 (c)-* 3 (4) 



>v&'rmrti/^ * m^^^c) * 3 (c)-* 3 Q4) \ n 

where the last inequality follows by the same argument as for (A. 2) □ 
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